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Purpose: This study evaluates the psychometric properties of three newly developed items 
assessing the quality of interpretation from the patient's perspective among Spanish-speaking 
limited English proficient Latino patients. 

Patients and methods: The authors examined the psychometric properties of a patient- 
reported measure of quality of interpretation using a cross-sectional survey study of 1 ,590 adult 
Spanish-speaking limited English proficient Latinos in the United States. Quality of interpreta- 
tion, doctor communication, and satisfaction with care were assessed using a three survey-item, 
an independent multiple-item measure, and a single-item measure, respectively. 
Results: Sixty-nine percent (1,104) of patients surveyed used interpreters. Cronbach's alpha 
for the three items assessing interpreter quality was 0.31, while dropping item three resulted 
in an alpha of 0.56. Items one and two were moderately correlated with doctor communication 
(r=0.39) and satisfaction with care scores (r=0.21) supporting construct validity. 
Conclusion: Two out of three survey items can be scaled to measure quality of interpretation 
from the patient's perspective. Quality of interpretation reported by patients is moderately 
associated with doctor communication and satisfaction with care. 
Keywords: interpreters, Latinos, doctor-patient communication, satisfaction with care 

Introduction 

Health care professionals and organizations in the US are caring for an increasing 
number of Latino patients. Latinos are a diverse ethnic group that includes many dif- 
ferent cultures, races, nationalities, and share a common language. Over 35 million 
people speak Spanish at home and 50% are limited English proficient (LEP). 1 - 2 LEP 
individuals are not able to speak, read, write, or understand the English language at a 
level that permits them to communicate effectively with health care providers. 3 Lan- 
guage barriers between health care providers and patients have been documented as a 
primary cause of health disparities in Latinos. 48 The National Standards on Culturally 
and Linguistically Appropriate Services (CLAS) developed by the Office of Minor- 
ity Health, and the Joint Commission on Accreditation of Healthcare Organizations 
(JCAHO) require health care professionals to determine the communication and lan- 
guage assistance needed for individuals with LEP. 9 However, hospitals are not providing 
language services in a manner consistent with the federal law and it is unclear how 
interpreter services are developed, implemented, or evaluated. 10 

The use of professional interpreters is a financially viable method for enhancing 
delivery of health care to patients," decreasing communication errors, increasing 
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patient comprehension, equalizing health care utilization, 
improving clinical outcomes, and increasing satisfaction 
with communication and clinical services for LEP patients. 12 
Among Spanish-speaking LEP Latino patients, interpreter 
use was associated with higher satisfaction with doctor com- 
munication, office staff helpfulness, and ambulatory care. 13 
The use of an interpreter was also independently associated 
with receiving explanations about possible medication side 
effects, directions, and purpose. 14 Whereas these studies 
support the use of interpreters, none examine the specific 
attributes of high quality interpretation from the patient's 
perspective. 

The purpose of this study is to evaluate the psychometric 
properties of the three newly developed items assessing the 
quality of interpretation from the patient's perspective among 
Spanish-speaking LEP Latino patients. The association between 
the patient-reported interpreter quality and communication with 
providers and satisfaction with care was also examined. 

Methods 

Data Source 

We analyzed pooled cross-sectional survey data collected in 
two waves between 2003 and 2006 from 1,590 Latino adult 
LEP women and men who participated in the Hablamos 
Juntos (HJ) national demonstration project. HJ was funded 
by the Robert Wood Johnson Foundation to improve 
doctor-patient communication by increasing access to and 
improving the quality of interpreter services for Spanish- 
speaking patients. 

In the HJ survey, patients chose to complete the 
interview in Spanish or English using computer-assisted 
telephone interviews. Survey response rates ranged from 
45% to 85% across sites. The survey did not collect 
objective or detailed information on the type of inter- 
preter used (ad-hoc versus professional). However, sites 
were included into this study in part for their need of 
interpreter services. When bilingual providers provided 
patient care, no interpreter was needed. A general evalu- 
ation of the HJ national demonstration project including a 
description of the study sites has been published elsewhere. 13 

Measures 

Patients were classified into three groups based on their need 
for and use of interpreters in the last 6 months. These categories 
were: 1) interpreter not needed; 2) interpreter needed and 
used always, usually, or sometimes; and 3) interpreter needed 
but not used. Patients who used interpreters always, usually, 
or sometimes were asked three questions about the quality 
of interpreters they used in the past 6 months: 1) how often 



did the interpreters listen carefully; 2) how often did the 
interpreters repeat all of their questions to the provider; and 
3) how often did the interpreters use words that were hard to 
understand? Prior literature identified these survey items as 
major challenges patients identify when using an interpreter 
to communicate with their medical providers. 15 

The psychometric property of content validity for ques- 
tions about the quality of interpretation was then assessed 
with a separate four-item measure asking questions about 
doctor communication in the last 6 months (item 1 , listening 
carefully; item 2, repeating questions; item 3, using words 
that are hard to understand; and item 4, spending enough 
time with patients) and a single global item measure of satis- 
faction with ambulatory health care during the last 6 months 
(score range of 0-10). A composite score of provider com- 
munication was computed by linearly transforming each 
item score to a 0-100 metric, then computing the average 
score among the four items. Other covariates included in the 
analysis were age (18-29, 30^14, or >45 years), education 
(0-6, 7—11, or >12 years), sex (male, female), marital sta- 
tus (married, separated/divorced/widowed, or single/never 
married), income (less than half of the poverty level, half 
at the poverty level, or above the poverty level), birthplace 
(United States, Mexico, Central America, or Caribbean), 
and self-reported health status (excellent, very good, good, 
fair, or poor). 

Statistical analyses 

Stata version 11.1 (StataCorp LP, Texas, USA) was used 
to conduct all analyses. First, item means, standard devia- 
tions, non-response rates, and item response frequencies, 
including ceiling and floor category endorsement rates, 
were determined. Inter-item correlation coefficients, item- 
scale correlation coefficients, and Cronbach's alpha for the 
three-item scale were also calculated. To assess the construct 
validity, correlations between each item, the scale score, 
and the measures of doctor communication and satisfaction 
with health care were computed. Linear regression analyses 
were then used to assess the association between the patient- 
reported interpretation quality, and doctor communication 
and satisfaction with care. 

Results 

Table 1 is a summary of the sociodemographic, insur- 
ance coverage and health status characteristics of the 69% 
(n= 1 , 1 04) study participants, who were eligible for this study 
because they used an interpreter in the past 6 months. The 
majority of the study participants were older (73%), insured 
(66%), Latina women (82%), with less than a high school 
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Table I Sociodemographic characteristics, insurance coverage, 
and health status among Hablamos Juntos survey participants 
(N=I,I04) 



rartlCipalll cndraCIcriallCs 




% 


Age (years) 






18-29 


292 


27 


30-44 


466 


42 


>4S 


346 


31 


Female 


909 


82 


Education (years) 






0-6 


475 


43 


7-1 1 


324 


29 


>I2 


305 


28 


Marital status 






Married 


615 


56 


Separated, divorced, widowed 


244 


22 


Never married, single 


237 


22 


Insured 


728 


66 


Family income* 






Less than half the poverty level 


240 


27 


Half to at the poverty level 


338 


39 


Above the poverty level 


297 


34 


Birthplace 






United States 


24 


2 


Mexico 


634 


58 


Central America 


66 


6 


Caribbean 


156 


14 


South America/other 


220 


20 


Self-reported health status 






Excellent 


73 


7 


Very good 


95 


8 


Good 


338 


31 


Fail- 


496 


45 


Poor 


96 


9 



Notes: *Poverty level was calculated using the US federal poverty guidelines. Two 
items were used to determine poverty level including: I) the number of people 
supported by income that respondent and/or their spouse or partner earn; and 
2) total household income amount. The English translation for Hablamos Juntos is 
"Together we speak". 

Abbreviations: N, total number of subjects; n, portion of subjects. 

education (74%), from Mexico (58%), and reported fair to 
good health status (76%). 

Table 2 shows the three survey items used to measure 
quality of interpretation from the patient's perspective. 
Interpreters always listened carefully (65%), always 
repeated questions (59.2%), and never used words that 



were hard to understand (45.2%). Item (1), "listen care- 
fully", had a mean score of 3.66 (standard deviation [SD] 
=0.70), 1.5% at the floor, and 65% at the ceiling. Item (2), 
"repeat all patients questions", had a mean score of 3.49 
(SD =0.88), 3.4% at the floor, and 59.2% at the ceiling. Item 
(3), "interpreters use words that are hard to understand", 
had mean score of 3.17 (SD =1.09), 45.2% at the floor, and 
12.8% at the ceiling. 

Item ( 1 ) "listen carefully", and item (2) "repeat all patients 
questions" were positively correlated (^0.40, P<0.001). 
Item (3) "interpreters use words that are hard to understand" 
was not correlated with items (1), and (2). Cronbach's alpha 
for all three items measuring interpretation quality was 
0.31 and increased to 0.56 when the last item ("interpreters 
use words that were hard to understand") was dropped. The 
composite for items (1) and (2) had a correlation of 0.40 
( J P<0.001) with doctor communication, and 0.28 (P<0.001) 
with satisfaction with care. Item (3) was not correlated with 
doctor communication or satisfaction with care. 

Patients who reported that their interpreters always 
listened carefully and repeated questions also rated their 
doctor communication and overall satisfaction with care 
higher than those that usually or never/sometimes listened 
carefully or repeated questions (P<0.001). Satisfaction 
with overall care mean scores (0-100) when interpreters 
listened carefully were as follows: never/sometimes (mean 
78.4, SD 20.1); usually (mean 83.1, SD 17.8); always (mean 
91 .9, SD 13.9). Satisfaction with overall care scores (0-100) 
when interpreters repeated questions were as follows: 
never/sometimes (mean 82.7, SD 22.1); usually (mean 84.7, 
SD 15.2); always (mean 91.9, SD 13.2). Satisfaction with 
overall care scores (0-1 00) when interpreters used words that 
were hard to understand were as follows: never/sometimes 
(mean92.1,SD 13.1); usually (mean 83.6, SD 18.3); always 
(mean 9 1 .9, SD 1 6.7). Using words that were hard to under- 
stand had a low correlation with the doctor communication 
composite score and satisfaction with overall care. 



Table 2 Survey items to measure patient experiences with the quality of interpretation among Hablamos Juntos participants who 
used interpreters (N= 1 , 1 04) 



Survey item 


N 


Mean 


SD 


Never 


Sometimes 


Usually 


Always 


No response 


n (%) 


n (%) 


n(%) 


n (%) 


n (%) 


How often did these interpreters listen 


1,104 


3.66 


0.70 


15(1.5) 


101 (7.7) 


128 (9.8) 


850 (65.0) 


10 (0.01) 


carefully? 


















How often did these interpreters repeat 


1,104 


3.49 


0.88 


45 (3.4) 


151 (1 1.6) 


1 15 (8.8) 


774 (59.2) 


15 (0.01) 


all of your questions to your doctor? 


















How often did these interpreters use 


1,104 


3.17 


1.09 


591 (45.2) 


260 (19.9) 


71 (5.4) 


167 (12.8) 


19 (0.02) 


words that were hard to understand? 



















Note: The English translation for Hablamos Juntos is "Together we speak". 
Abbreviations: SD, standard deviation; N, total number of subjects; n, portion of subjects. 
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Figure 1 shows doctor communication adjusted composite 
scores as they relate to each patient's reported measure of 
the quality of interpreters. Doctor communication composite 
score is statistically significantly better when interpreters 
always listen carefully and repeat questions compared to 
when they only do this usually, or never/sometimes. Inter- 
preter's use of words that are hard to understand did not show 
a graded or significant pattern of association with doctor 
communication. 

Discussion 

This study found that two of the three items evaluated are 
scalable and could be used to measure the quality of inter- 
pretation from the patient's perspective. The two items ask 
about whether the interpreter listened carefully and whether 
the interpreter repeated all of the patient's questions to the 
doctor. Each of these items asks about an important aspect 
of medical interpretation and addresses actionable content 
usable for quality improvement purposes. Alternatively, these 
two items can be scaled to produce a single score assessing 
the quality of interpretation. 

Patients reported better communication with providers 
and higher satisfaction with care when interpreters "listen 
carefully" (item 1) and "repeat all patient questions" (item 2) 
to doctor with a greater frequency in this study. Item (3), 
"interpreters use words that are hard to understand", was 
likely not scalable due to the impact of using a negatively 
phrased item in the survey where the other items were posi- 
tively phrased, or possibly because the commonly used medi- 
cal jargons and technical terms are difficult to understand 



regardless of who uses them. Interpreters overcome the 
overwhelming task of translating words that are hard to 
understand and simplifying terms and concepts in a culturally 
congruent manner. Despite these challenges, communica- 
tion between doctors and LEP patients through professional 
interpreters is associated with fewer communication errors, 
better patient comprehension, improved clinical outcomes, 
and higher satisfaction with communication. 12 Therefore, 
monitoring and improving the quality of medical interpreta- 
tion based on patient reports may lead to improved patient 
outcomes on multiple dimensions. 

This is one of the first studies to report a measure of 
quality of interpretation by medical interpreters from the 
patient's perspective. Previous studies have examined global 
satisfaction with interpreters and patient satisfaction with 
different interpretation modalities and our results expand 
the literature by focusing on unique aspects of the quality of 
interpretation from the patient's perspective. 1619 Traditional 
assessment of the quality of interpreters has focused on the 
interpreter qualifications and training without incorporating 
the patient experience. 20 Prior efforts attempt to capture the 
quality of interpreters by measuring the interpreters' ability 
(eg, certifications) and other technical aspects of language 
interpretation. This study shows that incorporating patient- 
centered measures of quality may help discriminate the 
interpreter effectiveness during the delivery of care to LEP 
patients. 

The results indicate that all three items on perceptions of 
interpreter quality are not scalable. Cronbach's alpha for all 
three items was low at 0.3 1 . The item that asked patients about 



100 



P<0.001 




P<0.001 



80.6 



91.6 



■ Never/sometimes 
□ Usually 

■ Always 



Listen carefully Repeat all patient Interpreters use words 

questions that are hard to understand 

Quality of interpreter services 

Figure I Doctor communication composite score and quality of interpreter services adjusted for patient characteristics. 

Notes: Higher scores (range 0— 1 00) indicate greater patient satisfaction with doctor communication; and the magnitude and significance of the results did not vary after 
adjusting for age, sex, education, marital status, income, insurance coverage, health status, survey wave, and site of care. 



179.2 



91.0 
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the " interpreters use of words that are hard to understand" 
did not correlate with the doctor-patient communication and 
satisfaction with care scores. This question was negatively 
worded and it may have been difficult to understand. Alterna- 
tively, the use of medical words during the clinical encounter 
is hard for patients to understand regardless of who says them 
(eg, doctor or interpreter). Although this study focused on 
Latinos, more studies are needed to understand the views of 
patients towards interpreters from other backgrounds such as 
Chinese, Vietnamese, and Koreans. Prior studies have shown 
that interpreter use among Asian patients may help increase 
cancer prevention screening and is positively associated with 
perceived quality of care. 2122 The findings from this study are 
the first step in developing a set of survey items that measures 
patient experiences with the quality of interpretation provided 
by medical interpreters. 

This study has several limitations. Our study sample is 
largely representative of low-income Latinos with a low level 
of education making the results nongeneralizable to other 
populations or to all Spanish-speaking Latinos. However, this 
group represents the growing Latino population in the US 
who will become insured under the Affordable Care Act. 23 
Participants were asked about encounters in a 6-month time 
frame and their responses to the survey questions are subject 
to recall bias, and socially desirable responses. Instrument 
bias cannot be excluded as a possible explanation for the 
results given that only two out of the three survey ques- 
tions were associated with the outcome measures. Patient 
responses were also focused on interpretation experiences 
that generally occurred over several visits. Although the sur- 
vey did not distinguish the type of interpreter used (eg, doc- 
tor, nurse, or other health professionals), these findings may 
be used to improve the patient-interpreter-provider experi- 
ence. The survey questions were not designed or tested with 
patient input but were designed in an exploratory fashion 
by investigators with content expertise. 1315 Further research 
is needed to determine what aspects of interpretation are 
important for LEP patients and to examine patient experi- 
ences with the quality of interpretation and the relationship 
to clinical outcomes. 

This study found that there is construct validity of a 
patient-reported measure of quality of interpretation with 
doctor communication and satisfaction with care when 
interpreters listen carefully and repeat all questions to doctor. 
Health systems across the country providing health services 
to an increasing Spanish-speaking LEP population may use 
these results to improve health care delivery and outcomes 
by incorporating research guided by patients. 
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